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Audio Effects Synthesizer with or without Analyser 
Introduction 

hi audio recording for music or film it is often desired to pass an audio signal tlirough 
an effect unit To alter the sound in a desirable way, for example, in film work a 
recording may be made to sound as if it were coming Tlirough a Telephone, from a 
distance or in a room with characteristic sound quality even though the original sound 
was recorded in a dead acoustic of a studio, hi music work more severe distortions 
may be required, for example passing the signal tlirough a guitar amplifier and speaker 
which is allowed To distort and back into a. microphone, or tlirough an analogue 
recording cycle onto and back from magnetic tape which is often considered to add a 
desirable sound quality*. 

Many devices exist to process signals in these ways, some specific to individual effects 
and some programmable to generate a range of effects on demand. Ilie purpose of this 
invention to allow* the simulation of a. large variety of such effects and further to allow 
existing effects to be analysed and the characteristics of the effect to be stored and 
simulated on demand. 

List of figures 

The invention is described by means of reference lo the attached figures which are 
described in detail ader the following summary' explanation. 

r*i£ 1 show's the process of analysing an existing effect unit by means of applying an 
impulse and recording its impulse response. 

Fi<£ 2 shows the application of an input sound stream lo generate a processed output 
stream by convolution with the sampled impulse response. 

Fig 3 shows the application of impulses of different magnitudes to an effect unit to 
obtain more than one impulse response appropriate to different impulse amplitudes. 
Fiy 4 shows the application of an input stream lo generate a processed oulpul stream 
by modifying the convolution so that a dillerenl impulse repsonse may be applied lo 
different input sample - in this case depending on amplitude of the inpul sample 
compared with a threshold shown dotted. 

Fig 5 shows a further refinement where an input sample between two thresholds is 
applied proportionately to the two impulse responses appropriate to the tliresholds on 
either side of the input sample. 

Fi<: 6 shows an alternative step pulse thai may he applied in the analysis process. 

Fig 7 shows the derivation of the impulse response from the step response by means of 

a sample shift and a subtraction. 

Fi*z 8 shows an arrangement of DSP and memory which can implement the steps of (i) 
analysing a device by means of generating impulses, storing the responses relumed 
from an effect under analysis and performing various 'tidying up' algorithms as 
described below to create the stored impulse responses, (ii) reading an inpul sample 
and generating the sample, (actor and address dala lor storage in memory as shown in 
fig 10. and (iii) executing the algorithm of Iigl2 It) generate each output sample aller 
each inpul sample has been read in. ihresholded and stored. A lixed or removable disc 
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drive may alsc be provided for program storage, long-Term storage of response data 
and exchange of data between machines. 

Fi<i 9 shows pari of the simulation processor wherein an input sample is analysed once 
lo determine two impulse responses lo be applied to it. where the start address of the 
impulse response stream in memory of the lower response appropriate lo ihis sample is 
stored, and where the sample is divided proportionally as determined by Ihe proximity 
of the sample amplitude to the two impulse response amplitudes and is for subsequent 
processing. 

Fig; 10 shows the algoritlmi of the applied to derive the values To be stored in fig 9. 
Fi<£ 11 shows the arrangement in memory aller ihe most recent input sample has been 
divided and placed in memory at F1(0) and F2(0) together wilh the selected address of 
Ihe lower of Ihe two appropriate impulse responses stored at A(0. The previous 
samples derived values are stored al Fl(l) r F2(T) r F1(2) : F2(2) etc together with iheir 
associated A pointers lor sullicienl previous samples lo exceed ihe length of ihe 
impulse responses used in ihe simulation. 

I'ig 12 shows the algorithm used to calculate an output sample from the data stored in 
memory in fig 1 1 . 

Fin 13 shows one possible multiple processor implementation wherein DSP1 is used 
first lo analyse an elVecl and generate the sampled impulse responses, then is used 
during the simulation phase lo generate ihe sample and factor memory entries. This 
memory is segmented inlo a number of areas each of which is accessible lo ils own 
DSP (2.3.4...) which can thus calculate pari contributions to each oulpul sample. These 
part sums are ihen led back lo DSP1 lo be summed lo generate the total output sample 
and fed lo the oulpul. 

Fig 14 shows an alternative way to implement The simulation algoritlmi where the 
heavily repeated inner loop of the convolution algoritlmi is simplified for maximum 
speed of execution, requring a simple multiply of each element of the impulse response 
buffer and accumulation into each element of the output sample buffer. 
¥\n 15 shows a How diagram ol'the process lo generate the lest pulses and record the 
impulse responses during anal\>i>. 

Fig 16 shows a flow diagram of an alternative process to generate the test pulses and 
record the impulse responses during analysis. 

Fi«z 17 shows the lest signal generated using the method o(Tig Hi. 
Fig IS shows a noise removal ^narejv where impulse responses derived from lower 
amplitude impulses may be selectively replaced by impulse responses from higher 
amplitude impulses in areas where the mean amplitude of the impulse response tails 
below a threshold representing the approach to a noise floor which would impare the 
simulation process. 

Analysis and Simulation of linear systems 

The transfer characteristic of a linear audio processor can he characterised by lis 
impulse response. A single puUe can be passed through an ellect unit and ihe resulting 
signal \vh ich emerges can be recorded as a sequence of digital samples. The eilecl can 
then be simulated in the digital domain by convolving a digital input stream with this 
impulse response lo produce a digital oulpul stream which matches thai which would 
have emerged from the sampled elVecl unit. The impulse response can be slored for 
recall later. This is illustrated in ligure 1 where an impulse T is applied via a D/A 
converter 1 lo produce an analogue impulse 2 which is fed inlo elVecl unit 3. The 
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output waveform 4 is fed via digital to analogue converter 5 and the resulting impulse 
response R is measured and stored.. Tig. 2 shows how the resulting impulse response 
R is used to calculate an output stream O from input stream i. Output sample O(0) is 
derived by taking input sample 1(0) and multiplying this by the first sample of response 
R (R(O)shown al 7). summed (or accumulated) with the product o 1*1(1 ) and the next 
older impulse sample (R( l ) shown at 8) and so on until the oldest input sample 
required T(6) is multiplied by R(fi) (shown al 10) is accumulated to make the latest 
output sample O(0). Thus the input stream of data T representing an input audio signal 
is convolved with the single impulse response R to produce each sample in output 
stream O. Although 6 samples are referred to here lor the length of the impulse 
responses, this is for clarity only and in practice many more samples are used. 

Where the edeci unit to be analysed already has digital input and/or output the D/A (1) 
or the A/D (5) may not be required as the digital signals can simply be fed to or fed 
back from the eflect unit.. 

Extension to non-linear systems 

Many effects including some of Those mentioned above are non linear in nature and the 
response of a signal path depends on the level of signal passing through the unit. To 
analyse such an effect unit it is possible to use a number of different impulses of 
different amplitude and to store a different resulting impulse response from each 
exciting impulse. This is illustrated in fig 3 for two different pulse amplitudes at fig 
3(a) and fig 3(b). Tigurc 3(a) duplicates the process shown in fig 1. using a sample 
pulse T of maximum amplitude to determine the response of the system under 
maximum amplitude conditions, l-'igure 3(b) duplicates the test but using a lower 
amplitude impulse T\ typically half the amplitude of the pulse in fig 3(a). 'Ihe 
resulting impulse response is shown at R. 'lliis is then increased in amplitude to 
produce the response at R" by multiplying each sample by the ratio of the maximum 
snmplc- amplitude at T over the lower sample amplitude at T\ This process is known 
as normalisation.. 

In practice to obtain a good analysis of the non-linear response of the system a number 
of different impulse levels are applied and a set of impulse responses (normalised to 
maximum amplitude) are obtained. Typically a set of 256 impulse responses are used 
using an equally spaced set of sample impulses from 1/256 of the maximum level up 
to the maximum level. 

After obtaining the set of impulse responses it is possible to simulate the non-linear 
effect. When simulating the effect it is necessary to examine each input sample and 
depending on the magnitude of the sample to use the appropriate impulse response in 
the convolution. This is shown in figure 4 for the case where the set of impulse 
responses uses just the two responses obtained in fig 3 and by comparison with fig. 2. 
hach input sample (at i) needed to make up the output sample is compared against the 
tlircshold between the two sampled levels, shown as dotted line 1 1 representing the 
magnitude of the lower level sample pulse of figure 3b. If the input sample exceeds 
this threshold (i.e 1(3). 1(4) and 1(5)). the impulse response of the higher amplitude 
pulse (shown at 12) is used in the convolution. If the magnitude of the input sample is 
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below The threshold (i.e. 1(0). 1(1). 1(2), 1(6)) The impulse response of The lower 
amplitude impulse (13) is used in The convolution calculation. 

"lliis process can be extended to use The impulse responses of any number of different 
impulse amplitudes by comparing the input sample against a number of Thresholds, hi 
the example where There are 256 equally spaced samples The level of The amplitude 
appropriate to any sample can be simply obtained by truncation of the magnitude of the 
sample to 8 bits (equivalent to 256 levels), "llic magnitude means that the sign of the 
sample value is removed to determine solely its amplitude. 

In fact it can be seen that the number of calculations required to generate an output 
sample is increased only by the need to make a decision for each input sample, Ihc 
decision needs only to be taken once for each input sample (regardless of how many 
times this sample needs to be used to calculate subsequent output samples) so in fact 
represents only a small increase in computational complexity, "lliis is shown in the later 
detailed description of the process of simulation, "lliis is important because it is 
possible to use a. large number of different impulse responses representing, say. 256 
different sample levels without increasing the number of calculations by anything like 
the number of levels used. 

Improvement by linear interpolation of impulse responses 

Whilst the above process provides a simulation of* the sampled elTect. an improvement 
in distortion characteristics can be made il" desired at the expense ol'some increase in 
computational complexity by modi lying the process so that instead of selecting 
helween two diHerenl impulse responses at a given level, a cross-Cade elVecl is used 
applying a proportion ol'lhe input sample to two impulse responses representing two 
adjacent sample levels. This is shown in lig 5 where a sample (14) a quarter oTlhe way 
between two sample thresholds (15. Hi) is applied three-quarters to the impulse 
response representing the lower sample level (17) and one quarter to the impulse 
respomse representing the higher sample level (18). No calculation needs to be 
performed with any of the other impulse responses. The computational complexity has 
thus doubled over the simple case oNig 2 plus the additional compulion to compute 
the ratio between the two levels. Although this represents more complexity than of the 
simple case oTIlg 2. it still represents an acceptable level of complexity to achieve the 
non-linear characteristic ol'many simulated ellecls. as once again this can be evaluated 
just once ("or each input sample. 

Switching between modes 

hi fact the simulator can be made to switch between the three cases of The simple linear 
simulator of fig 2. the non-linear simulator of fig 4 and the improved non-linear 
simulator of fig 5 according to the available computational power and according the 
length of the impulse responses used. This switching can be achieved by changing the 
stored program executed by the DSP processors used to implement the system. 

Reducing Noise in the sampled impulse response using an alternative 
sampling pulse 
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llic analysis pulse of fig 1 generates an impulse response but The resulting impulse 
response may also contain noise. Low frequency noise tends to be correlated between 
adjacent samples and during the resulting simulation phase may lead to either large DC 
offsets or general low frequency noise on the resulting output: 

l ; igurc 6 shows that instead of the unit impulse test signal T of figure 1 the step pulse 
ST may be applied, 'ilie step response SR is thus obtained. 

Hgurc 7 shows how to recover the unit impulse response required R. *llie step impulse 
response SR is sliifted on by one sample to get SR : which is subtracted sample by • 
sample from the response SR to yield the desired impulse response R. 'llius any 
substantial correlation between samples is largely eliminated, and any DC offset (i.e. a. 
constant bias found on all analysed samples) is totally removed, 'lliis can of course be 
calculated a.s the impulse response is sampled by storing the previous sample value 
S n _, amd subtracting it from the current sample S n so the value S rvl - S n is stored as 
the desired impulse response. 

"l"hc desired response at a number of different amplitudes can be found by using steps 
of a number of different sizes. 

Implementing the Analysis and Simulation 

The implementation of the analvsis and simulating machine will now be described by 
reference to figures R to 17. Figure R shows one arrangement using a stored program 
computer optimised lor digital signal processing. Typically one or more digital signal 
processor (DSP) devices 21 arc used. The DSP is attached to memory for impulse 
responses 22 and lor digital audio sample and control data 23. as well as program 
memory 24. These may in (act he part of" a single general purpose memory array or lor 
example the program memor\ 24 mav he part of* a separate array for higher 
performance. Audio input is provided either via analogue to digital converter 25 or via 
direct digital input 2(\ and audio output is led via digital to analogue converter 27 and 
via a direct digital output 2R A disk storage subsystem 2R is also connected and a user 
control panel and display 30 is provided lt> allow the user to initiate analysis, store or 
select stored impulse respon>e>. and select simulation modes, as well as initiate editing 
of" impulse responses as described later 

This device may generate the analvsis pulses, store and process the resultant impulse 
responses, and produce the simulation b\ loading the appropriate control program From 
disk or other storage medium 

One method of* implementing the process oT simulation will be described first. 

Figure 9 shows the process of reading in samples to he processed. A number of* 
impulse responses are stored in arrays ol'memories shown at 31. 32 and 33. Three are 
shown hut in practice any number may be used. These are identified by the address in 
memory of* the first element of each response at 34. 35 and 3n* and the memory array A 
can store these memory addresses, or pointers, represented by the arrows shown from 
memory elements of array A pointing to the appropriate impulse array. Each input 
sample arriving has one element of A reserved lor it to denote the appropriate pair of* 
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impulse responses- 31 - 33. The pointer addresses the lower of The two impulse 
responses representing the rlireshold below The input sample, and The second impulse 
response is always "die next one above representing the next higher Threshold level oi 
the input sample. 

Memory arrays 1 ; 1 and 1'2 store a pair of factors which are derived from The input 
sample and represent the input sample divided into two parts, one of which will be 
applied to the lower impulse response and one of which will be applied to the higher 
impulse response. The sum ofiiic.se two factors is always the input sample value itself 
and the sample is divided and stored in elements of arrays IT and F2 according to the 
proportion to be applied to each impulse response. Each input sample 37 therefore is 
divided in process 3& and loaded into the next free set of elements of The arrays A, Tl. 
i"2. A pointer 39 is then incremented to point into the next set of elements for the next 
input sample when it arrives. 

l ; igure 10 shows by means of a flow diagram the details of the process 35$. The input 
sample is compared with the various thresholds Tj. T 2 CTC representing the levels at 
which the impulse responses were sampled to find the two thresholds T n and T n , j 
below and above the input sample amplitude, i.e. such thai 



Tl should be noted lhal ilThe number of" equally spaced levels is a power of 2 (e.g. 256) 
Ihe threshold value- T can be determined by first removing the sign of the sample value 
ihen truncation lo the number of hils appropriate to the power of 2. (e.g. 8). 

The next step is lo calculate the proportion by which the sample amplitude exceeds Ihe 
threshold (shown as factor k). then divide the sample in this proportion to place into 
arrays Fl and F2. 

The input pointer is then advanced ready for the next sample. The array stored will be 
used for calculating each output samples up lo the length of the impulse responses, so 
a Her a number of output samples (for example 5000) the values just calculated will no 
longer be required. Standard techniques may be applied lo implement a 'cicular hulVer" 
where the pointer can be wrapped back lo the start aller this many samples, thus 
limiting ihe si/.e of the arrays. These techniques are well known and do not need to be 
described further here. 

Figure 1 1 ihus shows the layout of data in memory afler a number of samples have 
been read in and processed lo calculate output samples (ignoring any issues relating lo 
circular hullers). Tn ibis example and in the process shown in fig 12 ihe parenthesised 
suflix (0) is used to indicate a value relating lo the most recent sample. (1 ) ihe nexl 
older and so on. For ihe impulse response ihe sullix (0) means the first sample in the 
impulse response buller (i.e. the llrsl that arrived during ihe analysis process), (1 ) ihe 
nexl older elc up lo (M-1 ) which represent the most delayed impulse response sample, 
where M is ihe number of samples in each impulse response buller. 

Figure 1 2 shows the (low diagram lo calculate each output sample. Tl comprises a main 
loop starling al 43 which is executed M limes lor each output sample by means of the 
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control variable J which is zeroed at 41. 'Hie output sample is accumulated into the 
variable SOUT and so this is zeroed at 42 before entering the loop. "Hie first step in the 
loop at 43 (for the element J) is to load the impulse response pointer A(J) (being the Jth 
clement of array A). Using this pointer it is possible to load the appropriate impulse 
response sample from each of the appropriate response arrays, 'iliese are referred to as 
11 read from A(J)+J (at step 44) and 12 read from A(J)+J+M (at step 45). 

The two parts of the input sample 1 : 1 and 1'2 may be read from the IT. T2 arrays at 
offset J at step 46. llic two multiply and accumulate steps can be performed to 
accumulate the output sample into SOUT as shown at step 47. It is then only necessary 
to increment J (at step 48) and to test this against M (at step 4y). When J reaches M the 
output sample is complete and the loop is finished. 

"llic output sample value may then be fed to the output of the machine (fig S items 27 
and 28). Output pointers can then be moved on one sample ready for the next output 
sample. 

it should be mentioned that if cither of the two simplified processes of fig 2 or fig 4 is 
to be earned out some simplification of the above processes can be employed. Tor 
example, if cross-fading is not to be employed (as described in figure 4) the sample is 
not divided between IT and 1"2 but is simply stored wholcly in array IT. Thus all T2 
values are considered to be zero and so the memory array is no longer required and any 
steps relating to T2 can be by-passed, i.e. step 43. the second read at step 46 and the 
second multiply accumulate at 47. If the basic linear simulation of fig 2 is required the 
process is further simplified to eliminate thresholding the input sample, it is simply 
stored in array IT . Only one address of impulse response is needed so array A is now 
no longer required and in figure 12 step 43 is not required and the sole base address of 
the one impulse response is used instead of A(J) at step 44. 

It will be appreciated that the number of operations can be substantial as the length of 
the impulse responses used (M) may typically be 5.000 or longer. Accordingly, and 
depending on the speed of the DSPs it may be necessary to use more than one DSP to 
operate in real-time. 

Tigurc 13 shows one possible architecture of such a machine. DSP 51 processes the 
input sample into the arrays .V. IT and 1 ; 2 as already described but which are stored in 
segmented memory arrays 52. TTiis memory is -arranged so that it can be wholly 
accessed by DSP51 for loading with processed input samples, but is separated into 
sections which can be individually accessed by DSPs 53. 54. 55 etc. Tach DSP thus 
has access to pan of each array and for each output sample can perform part ot the 
multiply accumulate loop described in figure 12. "llic resulting parts of the 
accumulated output sample are written back to more shared memory 56. DSP 51 
(which otherwise is not heavily occupied by the input process) then adds all the 
separate parts together to produce the whole output sample, "llius ten processors (53. 
54 etc) could be used so that each performs 500 accumulation steps per output sample, 
and DSP 51 then has to sum the 10 partial values, llius 5.000 step impulse responses 
may be subdivided as appropriate to the speed of the DSP processors. Each DSP 53. 
54 etc is effectively executing the same program and so may be fed from -cither the 



7 




same or separate program memories 57. 58 etc. It is only necessary To map each part 
of the memory 52 to appear at the same address location in each associated DSP. 

It should be mentioned that there are other ways of dividing up the process which is 
functionally identical, producing identical output for the same data.. l ; or example fig 14 
shows a rearrangement of the process so that the bulk of the processing is done for 
each input sample, accumulating output as the input samples appear. After the Mth 
input sample is accumulated into the output sample buffer the first output sample is 
ready for output. 'Ilicreafter after each input sample is accumulated, another output- 
sample us available. This arrangement may suit some DSP architectures better 
depending on the exact nature of the DSP's instruction set. 

Tigurc 15 shows the process for generating the analysis pulse and reading the impulse 
response data. If it is only desired to obtain one analysis at one amplitude it is not 
necessary to go round the loop more than once, and a single amplitude should be used 
that does not overload the unit under test (refer to the configuration of figure 1). To 
determine this amplitude may require some repeats of the process and auditioning of 
the simulation as well as observing any overload indication on the unit under test. 

To obtain a set of impulse responses it is advisable to start with the lowest amplitude as 
shown at step 61 of figure 15. At step 62 it is desirable to wait for any residual effect 
of a previous signal passing tlirough the unit under test, as some effect devices may 
continue to generate output for some time after stimulation, for example due to 
resonances or reverberations, lliis process is done by monitoring the return signal from 
the device under test and obseiving the noise floor. If this is decaying over a short 
space of time the process simply waits for the noise floor to become stable. It would 
generally be advisable to apply to time limit which can be user selectable in case of a 
varying noise floor causing an indefinite wait. 

At step 63 a test pulse of the desired amplitude is emitted by setting the output stream 
to the value A in one sample period and back to zero at the folio whig sample. At step 
64 the returning stream is monitored and stored (usually into RAM) until The time limit 
set by the machine is reached, lliis is determined by the number of steps which the 
simulator can process in real time, or can be limited by memory available or be further 
limited by user intervention to minimise processing requirements. It should also be 
noted that the process of step 62 can also be followed to determine when there is no 
significant further response and further used to shorten the. sampling process. 

If the amplitude of the test puUc is less than the maximum amplitude then each element 
of the measured response is sealed up in The proportion A ma .yA currenT to normalise the 
response stored aT step 64. 

Once The sampling is complete the amplitude is tested at 65 to determine if the process 
is complete. If not. the next Ixigher level of amplitude can be loaded into A and the loop 
repeated. 

It is possible to use a descending set of test pulses instead but the two advantages of an 
increasing stream is (i) there is likely to be less ongoing disturbance from preceeding 
test pulses as they were of lower amplitude, and (ii) in the event that the operator hears 




the increasing pul.se levels causing damage to equipment (or his hearing) he can 
intervene to stop the test. 

A useful refinement is to allow the system to generate a continuous stream of pulses at 
user definable amplitudes solely for the purpose of allowing the operator to select the 
optimum levels of signal to pass through the device under test. 

bigurc 16 shows the improved method of sampling the test unit and figure 17 shows 
the resulting test signal applied to the-D/A converter and digital output of the machine 
dining the test process outlined in fig 6. 'Ihis is described by reference to both fig 16 
and 17. 

Once again the process can be done just once using a single amplitude test, pulse or the 
loop shown in the diagram can be carried out to obtain the set of responses. 

At step 71 the initial minimum amplitude value is selected. The output stream fom the 
pulse generator is set to the value -A/2 at step 72. producing the. output step 81 in fig 
17. At step 73 it is necessary to wait for any resulting effects from the unit under test to 
die out. in this case the difference signal from the device under test is used, "lliis is 
specified as the current sample received S n minus the previous sample S n _,. This 
stream is measured to determine when the device under test reaches the general noise 
floor of the device. 

Ihe test signal is now generated by stepping the output stream by the amplitude A. by 
stepping in a direction to cross the zero value, as described at step 74. "lliis is shown at 
£2 in fig 17 for this first value, llie resulting output of the device under test is now 
monitored and the difference stream S n - S n _, is stored as the impulse response. 

if the amplitude of the test pulse is less than the maximum amplitude then each element 
of the measured response is scaled up in the proportion A ma:i /A current to normalise the 
response stored at step 75. 

At step 76. value A is tested to see if it has reached the maximum step desired and if 
not it is increased to the next amplitude to test (step 77). 'Hie process then loop^ back 
to step 73 where the effect of the stimulation is allowed to die out. then the output is 
stepped again, this time in the opposite direction, lliis is shown at K3 in fig 17. Once 
again the output stream is monitored and the difference signal is stored. It is not shown 
in the diagram but when the test pulse is negative-going the resulting impulse response 
has its sign reversed when being stored to compensate for the opposite sense of the test 
pulse. 

When the complete set of impulse responses has been stored they may be windowed, 
edited in duration or subjected to noise improvement processing as described later. 

It should be noted that the step of waiting for any residual stimulation of the device 
under test (shown at step 62 of fig 15 and step 73 of fig 16) may be replaced by a fixed 
wait period in many instances where there is not significant energy storage in the 
device under test, lliis has a benefit that the output test signal becomes the same for 
any test and may thus be recorded (preferably in digital format) for application to a 
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device remote from the analysis machine, llie resulting output from the device under 
test may also be recorded and can later be analysed by the analysis process, ilie only- 
significant alteration to the process of analysis is that instead of generating the test 
pulse it is necessary simply to wait for any significant response to appear in the 
recorded stream and store this and the following impulse response as being the 
response to the first test pulse, then similarly wait for the appearance of further 
responses to later pulses and thus obtain a complete set of impulse responses. *l*his is 
useful as an operator may simply cany a tape of the test stream and if he encounters a 
device which he wishes to analyse he simply plays the tape through the device and 
records the result for later analysis and simulation. A useful refinement to improve this 
process is to precede the test signal with a short burst of tone which both can be used 
for level setting and can be recognised at the analysis stage and taken as a trigger to 
start the process of looking for response signals at a known period after the tone burst. 

Although the sampled effect is shown as an analogue device, a digital processor may 
be sampled by applying the sample impulse directly to the digital input and sampling 
directly the output impulse response. 

Improving noise 

A potential problem with the system is that significant noise generated by the device 
under test will appear as noise in the simulated effect. 'Hiis can be made worse when 
using impulse responses derived at low levels of test. However since many effects 
become linear as the level tiirough the device decreases it is often just necessary to use 
a set of impulse responses derived at relatively high levels, and below this tlircshold of 
linearity, to use the impulse response derived at the highest linear level in place of all 
lower impulse responses, "lliis can be done under manual intervention from the 
operator who can choose a balance between desirable non-linearity and accepable noise 
by auditioning the effect of selective replacement. 

Where it is not possible to acliieve a desirable balance because it is desired to preserve 
lower level non-linearities where noise is a problem, it is possible to selectively modify 
pans of the impulse responses derived at low levels by replacement with matching 
parts of the re sponses from liigher level impulse responses, where the areas to be 
replaced are determined by evaluating the absolute amplitude of each section of the 
response and replacing it where the impulse response is seen to be near the noise floor. 

l'igure 1U shows some details of this process. A higher level impulse response is 
shown at (a) and a lower level one at (b). An envelope 91 (at (c)) is generated 
representing the average level of a local region of the impulse response (b). iliis is 
evaluated by calculating the RMS value of the nearby samples, weighted towards the 
current time for each point in the envelope. In practise this may encompass 400 to 500 
samples. Hie envelope 91 is compared with a threshold 92 which may be user 
determined or estimated by comparing with the noise floor found during the analysis 
processes of fig 15 and 16. hi fig IX (c) it can be seen that the example envelope 91 
falls below the threshold at 93 and rises again above it at 94. Trom this a * cross-fade 7 
envelope is generated (d). Using this envelope the impulse response (b) is selectively 
replaced with impulse response (a) with a soft crossfade of several milliseconds at each 
end of the replacement (shown as the ramps 95 of the crossfade envelope) to generate a 
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new impulse response (c) where the lower level area is replaced by The lower noise 
floor impulse response taken at the higher level (a). 

'ilie new impulse response is generated according, to the formula. 

r-c.a + (l-c).b 

where c is the envelope value, a is the sample value from the higher level impulse 
response and b is the sample value from the lower level impulse, and r is the resultant 
sample to replace in the lower level sample, 'ilie period (.) represents multiplication, 
"lliis provides a. crossfade to the higher level impulse response where the lower level 
signal was below the threshold. 

To determine the noise floor automatically it will be seen that for the impulse 
responses taken at lower levels there will be a level which the envelope never drops 
below due to noise, "llic threshold can thus be set say 50% above this and applied 
progressively from the near The highest level sample down To the lowest level. It is 
appropriate to starr The process at The impulse response some 12dJJ below below the 
maximum, in other words that sampled with a sample pulse about a quarter of the 
amplitude of the highest sample impulse used. 

Length of impulse responses and processing power 

The impulse response lengths required depend on ihe energy storage characteristics ol" 
the effect sampled. Typically an equaliser, valve amplifier or speaker/microphone? 
combinations in short reverberation environments can be simulated with impulse limes 
of up to l/10lh second, or lor example 5.000 samples. Each output sample will require 
the accumulation of 5.000 values of input sample multiplied with 5.000 impulse 
response samples, or 250 million operations per second assuming a 50.000 sample per 
second sampling rate. Thus the simple case of llg 2 requires 250 million multiply 
accumulates (MAC) operations on linear arrays of data, while the process shown in fig 
1 2 requires correspondingK more steps to be repealed this many limes. 

To simulate fulK reverberant etlecls. impulse responses of several seconds can be 
needed resulting in a proportional increase in processing power. This is quite possible 
within a network of DSP chips To make the best use of a particular hardware 
implementation however the simulator should be arranged to switch amongst the three 
simulation methods described the linear simulation of fig 2. the simple non-linear 
simulation of fig 4 and the interpolated simulation of llg 5 (shown in greater detail in 
figs 8 onwards). This means thai in simulations where non-linearity is not required 
more processing power is axailahle lor longer impulse responses and therefore longer 
reverherenl periods. 

Windowing ofimpul.se responses 

It should be noted Thru where an effect is sampled but the impulse response exceeds the 
length of sample which it is possible to calculate in real-time in a particular hardware 
implementation, it is necessary to truncate the impulse response by windowing the 
response, i.e. effectively fading off the last l/20th second or so linearly to zero, hi fact 
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all sampled impulse responses should be windowed in this way to prevent any glitch 
effects from suddenly truncated noise signals. 

Editing impulse responses 
Trimming the start and end 

There is always some delay between ihe application of an impulse lo a device and ihe 
output response. This results in an equal delay in the simulation. Sometimes the effect 
can he improved hy removing or reducing ibis delay and in any event ibis shortens the 
sample lo reduce compualional requirement. Tl is simple lo arrange lor the operator lo 
trim oil" samples from ihe Iron I of* the sample - the elTect of which he can audition lo 
his lasle. or a threshold level can be set on a response lo automatically trim olT any 
initial response below ibis 'noise* threshold. This threshold would typically be applied 
-lo the impulse response derived from the highest level sampled signal and once 
determined, the same amount is trimmed oil* the start of the whole sel of impulse 
responses. 

Frequency slutting 

Interesting variations of the sampled effect may be made by resampling each impulse 
response lo a higher or lower frequency using standard resampling algorithms. The 
effect of each change can be auditioned lo the lasle of ihe operator. This allows various 
effects, such as for example the resonances in the sampled ellect being matched lo 
dominant frequencies in the signals to be processed. 

Combination of effects 

Tl is possible lo simulate the ellect of passing a signal through two successive effects 
IVy taking each impulse response of ihe first effect and passing il through the simulation 
of ihe second effect lo generate a new impulse response for that sample amplitude. 
This is done for each impulse response of ihe first ellect lo achieve the same number of 
new impulse responses reproenling ihe combined effect. In the case of the simple 
method of 2 tins represents s simple convolution of ihe impulse responses. 

Interpolation and extrapolation effects 

The sel of impulse responses representing the range of levels passing through an ellect 
embodies the non-linear characteristic of the sampled eflecl. New and interesting 
effects can be achieved b> partially linearising the ellect. To do this a subset 
representing a range of the original sel is taken and a new complete sel of impulse 
responses is generated by interpolation of* each sample step through the sel of impulse 
responses. 

Tl is also possible to make the non-linearity more extreme by extrapolating beyond the 
original range. This can result on extreme values of samples and generally the whole 
sample sel will have lo he attenuated to keep ihe output within acceptable limits. 
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After any .such recalculation the operator can again audition The effect to achieve a. 
desired effect, llie erorapolation effects will generally become very strange but small 
amounts of extrapolation may generate desirable distortions. 

Deriving impulse responses from virtual systems 

II should be noted that as well as sampling exisliing elVecls it is quite possible to 
generate a computer model of* a new device and calculate a sel of* impulse responses. 
These may then be loaded into the simulator to allow the efleel to be auditioned in real- 
lime. In this way the simulator can emulate arbitrary digital effects such as equalisers, 
or simulated physical models e.g. room simulations, and especially non-linear devices 
such as amplifier or loudspeaker simulations. 

Tn the case of* simple equalisers which are linear in character only one impulse response 
is generated for any chosen equaliser. These can be calculated and loaded rapidly to 
allow real-lime variation of* equaliser characteristics. The simulator thus provides a 
powerful simulator of a wide range of'equaliser devices complete with real-lime user 
control of parameters. Tn practice when a parameter is varied the new impulse response 
is calculated and loaded and a cross-fade can be performed to the new efleel to remove 
switching e fleets when parameters are varied. 

Arithmetic 

As with all good signal processing practise care must be taken with rounding or 
truncation of digital value. It is best to preserve precious of all calculations to for 
example 32-bits if fixed point arithmetic is used of 24-bits of mantissa if floating point 
is used. Hnal digital output can be reduced to the desired digital output format using 
appropriate and known bit reduction Techniques. 

Further Uses 

The; process described can he used to simulate efleel which are asymmetric by also 
taking into account the sign of ihe signal to be processed and taking separate analysis 
samples for positive going test pulses and negative going test pulses. This asymmetric 
processing could be appropriate, for example, to simulation of high sound pressure 
level effects in air where the sound carrying capacity of air is asymmetric. 

A further use of the process of selecting between impulse responses is for using some 
other characteristic than the amplitude of* the incoming sample to control selection. For 
example a number of different effects can be placed into each impulse response 
memory and be selected between (including using the crossfading lechique) under user 
control or in a repetitive manner using a control oscillator. Tn this way a lime varing 
effect can be simulated, for example a rotating Leslie loudspeaker cabinet or a varying 
Hanger or phaser effect. The required impulse responses can either be calculated to 
generate an ellecl or an existing unit can be sampled at a number of" di ll'erenl sellings 
representing a range which the efTecl is normally used to sweep through. Thus a Leslie 
loudspeaker can he analysed at a number of di ll'erenl sialic positions of ihe rotating 
speaker and the resulting set of impulse responses stored. Then cycling through the 
responses will simulate rotation of the speaker (including the doppler eflecls of* the 



13 



moving speaker as different impulses responses will have different delays built in 
representing different direct and indirect signal paths from the loudpscakcr analysed). 

Although a mono system is described typically two units will nm in parallel to allow 
stereo in and stereo out. Often the input signal will be the same applied to both 
channels to generate stereo samples effects from mono sources. 

Non real time and general purpose computers 

Note lhal il is also possible lo process in non-real lime using less hardware and ihis can 
be done on typical general purpose desk-lop computers. However the best use is 
achieved when operating in real-lime whether ihis is on a high performance general 
purpose computer implementing the algorithms described or by means of dedicated 
multiple DSP architectures. 



14 



CLAIMS 



1 . A method for simulating the effect of an audio effect 
processor comprising the steps of: 

a) storing the impulse response of the audio 
processor; and 

b) applying the . stored impulse response to an 
input signal to derive an output signal to 
which the audio effect of the processor has 
been applied. 

2. A method according to claim 1, wherein the step of 
storing the impulse response comprises storing a set of 
digital samples representing the impulse response and the 
step of applying the stored impulse response comprises the 
step of convolving a first series of digital samples 
representing the input signal with the set of digital 
samples representing the impulse response and to give a 
second series of digital samples representing the output 
signal. 

3. A method according to claim 1 or 2, including the 
step of storing impulse responses for at least two 
impulses of different amplitudes and the step of applying 
the impulse response to the input signal comprises the 
step of assessing a characteristic of the input signal and 
selecting one of the impulse responses to apply to the 
input signal in dependence on the result of the 

as ses sment . 

4. A method according to claim 3, in which the step of 
assessing a characteristic comprises determining whether 
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the amplitude of the input signal is above or below a 
predetermined threshold . 

5. A method according to claim 4, further comprising the 
step of determining whether or not the amplitude of the 
5 input signal falls within a predetermined range, applying 

more than one impulse response to the input signal if the 
result of the determination is that the amplitude of the 
input signal does fall within the predetermined range and 
deriving the output signal therefrom. 

io -6. A method according to claim 5, in which the more than 



one impulse responses applied to the input signal are 
applied in proportions which sum substantially to 1. 



15 



7. A method according to claim 6, in which the 
proportions of the impulse responses applied to the input 
signal are dependent on the position of the amplitude of 
the input signal within the predetermined range. 
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